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Model  reduction 


In  order  to  get  reliable  results  from  agent-based  models,  simulations  typically  have  to  be  run  many  times  and  results  averaged,  given 
that  while  the  rules  determining  agent  behavior  in  a  model  may  he  fixed,  they  often  involve  random  processes  (e.g.,  movement  in  a  random 
direction).  The  first  step  towards  model  reduction  involves  figuring  out  how  many  simulations  must  he  run  (for  fixed  parameter  settings)  in 
order  to  obtain  reliable  results;  this  value  may  he  model  dependent.  When  we  refer  to  data  obtained  from  the  model,  we  mean  data  obtained 
from  this  pre-determined  number  of  repeated  simulations. 

The  first  step  towards  model  reduction  is  to  reduce  the  physical  landscape  of  the  model,  scaling  the  number  of  each  agent  type 
accordingly.  We  collect  data  at  each  physical  size,  and  compare  results.  In  some  models  there  exist  what  are  known  as  ‘phase  transitions’, 
where  certain  phenomena  occur  which  may  not  occur  at  different  sizes.  The  goal  of  this  phase  of  model  reduction  is  to  determine  how 
much  we  can  reduce  the  physical  landscape  without  introducing  or  removing  any  relevant  phase  transitions,  because  the  reduced  landscape 
will  result  in  faster  run  times.  It  is  possible  to  think  of  such  spatial  reductions  as  aggregations  rather  than  a  smaller  ‘world’.  In  other  words, 
if  we  reduce  from  100  agents  to  25,  we  can  either  think  of  this  as  a  smaller  sample  size,  or  we  can  interpret  it  as  if  we  are  putting  our  agents 
into  groups  of  4  and  evaluating  them  as  groups  instead  of  individuals. 

We  use  Pearson’s  correlation  coefficient  on  the  data  to  determine  exactly  how  small  we  can  scale  our  model  and  still  retain 
qualitatively  similar  behavior.  We  correlate  the  data  at  a  reduced  size  with  the  data  from  the  original  size  of  the  model,  and  set  a  benchmark 
-  for  example,  we  may  require  that  the  reduced  data  correlate  at  a  value  of  0.95  or  higher  in  order  to  he  said  to  he  within  the  hounds  of 
acceptability.  In  this  way,  we  use  a  statistical  measure  to  determine  the  accuracy  of  our  reduction  instead  of  relying  on  guesswork  or 
intuition. 

This  reduction  technique  was  applied  both  to  the  Rabbits  and  Grass  model  (which  is  spatially  homogeneous)  and  to  the  SugarScape 
model  (which  is  spatially  heterogeneous).  In  both  cases  we  were  able  obtain  results  in  approximately  25%  of  the  original  run  time,  without 
the  loss  or  addition  of  phase  transitions.  Code  was  written  forNetLogo  that  automatically  reduces  a  spatially  heterogeneous  landscape  to 
the  user’s  desired  size,  allowing  the  user  to  choose  the  reduction  algorithm  to  he  used  (nearest  neighbor  orbi-linear  interpolation). 

The  following  paper  is  in  preparation:  Scaling  methods  and  heuristic  algorithms  for  agent-based  models.  Matt  Oremland,  Reinhard 
Lauhenhacher. 


SugarScape 

The  SugarScape  model  was  subjected  to  the  model  reduction  techniques  described  above  as  a  test  subject  of  a  spatially  heterogeneous 
model.  However,  a  different  technique  was  developed  as  well  -  that  of  converting  the  model  dynamics  to  a  series  of  difference  equations, 
which  could  then  he  subjected  to  control  and  thereby  replace  simulation. 

The  model  consists  of  four  categories  of  agents,  and  four  distinct  spatial  regions.  Each  agent  has  an  energy  level  from  zero  to  fifty. 
Thus  for  each  category,  200  difference  equations  were  implemented,  one  for  each  energy  level  in  each  spatial  region.  For  example,  the 
equation  S2,13(t)  keeps  track  of  how  many  agents  there  are  in  region  2  with  energy  level  13. 

The  hulk  of  the  work  for  this  approach  is  to  determine  exactly  what  these  equations  should  he.  In  general,  they  are  dependent  both  on  the 
rules  of  the  agent-based  model  and  on  the  information  one  needs  to  obtain.  In  this  case,  we  were  interested  in  taxing  agents  based  on  their 
energy  level  and  spatial  location,  so  we  needed  to  keep  track  of  both  variables.  If  one  were  interested  only  in  spatial  location,  the  number  of 
equations  could  he  substantially  lowered. 

Since  the  equations  depend  on  what  information  we  are  interested  in,  automatic  conversion  of  agent-based  models  to  systems  of  equations 
seems  daunting.  However,  we  are  currently  working  on  parameter  estimation  methods  that  show  some  promise.  In  this  approach,  we 
generate  data  from  the  simulation  and  attempt  to  determine  parameters  that  fit  the  equations  to  the  data.  This  work  has  been  successful  with 
the  Rabbits  and  Grass  model  and  is  currently  underway  for  a  more  spatially  complicated  version  of  SugarScape. 

Paper  in  preparation:  Mathematical  conversion  and  analysis  of  agent-based  models.  Matt  Oremland,  Reinhard  Lauhenhacher. 


Control 

Control  for  ABMs  has  taken  one  of  two  forms:  when  not  converting  the  model,  we  apply  our  model  reduction  techniques  and  use  data  from 
simulations  in  order  to  determine  the  cost  of  a  particular  control.  This  can  he  computationally  expensive;  on  the  other  hand,  this  strategy 
can  he  applied  to  virtually  any  model,  no  matter  how  complicated.  The  only  concession  one  must  make  is  that  the  cost  is  determined  as  an 
average  value  from  a  repeated  number  of  simulations,  and  is  not  able  to  accommodate  single  runs  while  retaining  accuracy. 

The  actual  method  of  control  used  is  in  the  form  of  heuristic  algorithms.  In  general,  these  algorithms  search  through  a  virtually  infinite  set 
of  controls  and  evaluate  them,  then  incorporate  some  method  of  refining  the  controls  in  order  to  obtain  even  better  results.  Evolutionary 
algorithms  combine  two  control  choices,  for  example,  hoping  to  get  the  best  features  of  each.  Others,  such  as  simulated  annealing,  refine  a 
single  control  rather  than  working  with  a  population  of  controls. 

The  drawback  of  these  methods  are  that  they  cannot  he  guaranteed  to  determine  a  globally  optimum  control,  and  that  there  is  no  way  to 


determine  ahead  of  time  which  algorithm  will  work  best  for  a  given  model.  On  the  other  hand,  the  results  are  far  better  than  those  obtained 
by  random  search  (as  we  have  shown  in  the  course  of  this  work).  In  addition,  given  the  typical  interest  in  agent-based  models  as 
simulations  of  real-world  systems,  one  may  be  satisfied  with  controllers  that  are  better  than  any  previously  known,  rather  than  requiring 
that  they  be  provably  optimal. 

We  have  implemented  the  following  heuristic  algorithms:  random-mutation  hill  climbing,  simulated  annealing,  genetic  algorithms,  and 
Pareto  optimization.  In  general,  genetic  algorithms  returned  the  best  results  in  most  cases.  Pareto  optimization  is  a  means  of  multi-objective 
optimization,  wherein  one  does  not  have  to  determine  a  cost  function  ahead  of  time,  but  rather  only  specify  the  variables  of  interest.  For 
example,  if  we  wish  to  determine  a  controller  that  reduces  cost  and  maximizes  efficiency,  Pareto  optimization  allows  us  to  conduct  a  search 
without  specifying  which  of  those  two  aims  is  the  priority,  or  having  to  assign  specific  weights  to  them.  Rather,  this  method  returns  a  suite 
of  controls,  each  optimal  under  different  conditions.  This  allows  the  user  to  specify  priorities,  and  change  them  without  having  to  re-run  the 
algorithm. 

For  models  wherein  difference  equations  have  been  obtained,  certain  information  is  more  easily  obtained:  we  can  solve  numerically  for 
steady  states,  and  perform  stability  analysis.  However,  the  control  methods  we  have  examined  are  currently  limited  to  heuristic  algorithms. 
The  main  advantages  of  model  conversion  are  the  drastic  reduction  in  run  time,  and  the  precision  of  the  model  description  (which  is  an 
ongoing  issue  in  the  agent-based  modeling  community).  We  are  also  working  on  methods  which  will  take  advantage  of  mathematical 
theory  in  order  to  not  have  to  perform  heuristic  searches  on  the  difference  equations,  but  rather  exploit  known  techniques  for  optimal 
control  of  discrete  equations. 


